If you know the right string of seemingly random characters to add to the end of a prompt, it turns out just about any chatbot will turn evil. A report by Carnegie Mellon computer science professor Zico Kolter and doctoral student Andy Zou has revealed a giant hole in the safety features on major, public-facing chatbots — notably ChatGPT, but also Bard, Claude, and others. Their report was given its own website on Thursday, "llm-attacks.org," by theCenter for A.I. Safety, and it documents a ne...
If you know the right string of seemingly random characters to add to the end of a prompt, it turns out just about any chatbot will turn evil. A report by Carnegie Mellon computer science professor Zico Kolter and doctoral student Andy Zou has revealed a giant hole in the safety features on major, public-facing chatbots — notably ChatGPT, but also Bard, Claude, and others. Their report was given its own website on Thursday, "llm-attacks.org," by theCenter for A.I. Safety, and it documents a ne...
Share this Article
Recommended